Tional Training of Energy Based Models
نویسندگان
چکیده
In this paper, we study deep generative models for effective unsupervised learning. We propose VGAN, which works by minimizing a variational lower bound of the negative log likelihood (NLL) of an energy based model (EBM), where the model density p(x) is approximated by a variational distribution q(x) that is easy to sample from. The training of VGAN takes a two step procedure: given p(x), q(x) is updated to maximize the lower bound; p(x) is then updated one step with samples drawn from q(x) to decrease the lower bound. VGAN is inspired by the generative adversarial networks (GANs), where p(x) corresponds to the discriminator and q(x) corresponds to the generator, but with several notable differences. We hence name our model variational GANs (VGANs). VGAN provides a practical solution to training deep EBMs in high dimensional space, by eliminating the need of MCMC sampling. From this view, we are also able to identify causes to the difficulty of training GANs and propose viable solutions. 1
منابع مشابه
Investigation on Equivalent Trans-utilization Mode and Benefit of Wind Energy
For economic benefit of wind power generation, the equivalent conversion relationships and models between the different “quality” energy are studied deeply in the conversion processes of wind energy. Considering the effect of load demand characteristics and energy supply price on the wind energy utilization mode comprehensively, the multi-objective trans-utilization optimization model of wind e...
متن کاملVoice-based Age and Gender Recognition using Training Generative Sparse Model
Abstract: Gender recognition and age detection are important problems in telephone speech processing to investigate the identity of an individual using voice characteristics. In this paper a new gender and age recognition system is introduced based on generative incoherent models learned using sparse non-negative matrix factorization and atom correction post-processing method. Similar to genera...
متن کاملIdentification and ranking of key indicators of health, safety, environment and energy education performance based on multi criteria decision making (MCDM)
Introduction: Health, safety, environment and energy management systems are one of the most popular models, and Implementing and deploying it will prevent waste of time and money. Execution, Continuity Optimal performance it requires effective training. The purpose of this study was to identify and rank important indicators for health, safety, environment and energy education. Methods: This re...
متن کاملModeling and Prediction of FRP Composite Cylinder tubes Crashworthiness Characteristics
In this paper, numerical simulation of FRP composite cylinder tubes progressive crushing processes is conducted using LS-Dyna. Details on the numerical modeling strategy are given and discussed. It is found that triggers introduced in the numerical simulation can effectively model the bevel trigger at the end of the tubular specimens. It is also found that two-layer finite element model based o...
متن کاملComparing the Effectiveness of Psychological Training based on Olson and McMaster Models in Enhancing Family Functioning of Female Teachers
The present study set out to compare the effectiveness of psychological training based on Olson and McMaster models in enhancing family functioning of female teachers. This quasi-experimental research had a pretest-posttest control group follow-up design. The statistical population of the study was comprised of 550 married female teachers in the Khorramdarreh County in school year 2016-17. The ...
متن کامل